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ABSTRACT 

. , This study investigated changes in test performance 

of disadvantage! people as a result of literacy training! Differences 
between score s obtained before and after basic literacy training we?e 
obtained. The study also investigated predictors of g 

vccab,T?a^ t ' teS ^ SC ° re im P rover *«mt. Standardized achievement tests of 
reading comprehension, arithmetic computation, and 
arithmetic reasoning were administered in 16 states. Raw scores were 
converted to grade score units and five derived scores were comouted 
The General Aptitude Test Battery (GATE) tests were also 

' Me * n achieve " 15 " t test improvement was approximately 

tMinina Tn?tia? ™ a”® 9ra ? e equivalent for a mean of 208 hours of 
1 S 1 read 3- n ? achievement, minority group status, GATB 
aptitudes, and nonreading test performance predicted arithmetic 

not r as e ored : J” gen ® ral » ^he same variables did not predict or were 
not as predictive of reading achievement improvement. (Author) 
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FOREWORD 



Extensive research conducted under the Federal-State cooperative test 
research program in the Training and Employment Service has led to the 
development of many tools useful in vocational counseling and placement* 
These tools include aptitude tests s proficiency tests ^ and non-cognitive 
measures based on instruments such as interest inventories and biographical 
information blanks* 

The purpose of this series of reports is to provide results of significant 
test research projects as they are completed* These reports will be of 
interest to users of the tests and to tost research personnel in other 
organ i z at ion s * 

This report was prepared in the Division of Counseling and Testing Services 
of the United States Training and Employment Service by Eileen D,> Haggerty 
and Marlin L. Ferral under the general direction of Anthony J, Fantaci 9 
Chief of the Division 9 and Beatrice J* Dvorak 9 Assistant Chief of th© 
Division. Statistical services were provided by John A* Hawk of the 
Division of Counseling and Testing Services. 

U,S* Training and Employment Service 
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This study Investigated changes in test performance of disadvantaged 
persons resulting from literacy training* Differences between scores 
obtained before basic literacy training and scores obtained from re- 
testing after basic literacy training we re obtained* 

The study also investigated predictors of achievement test score 
improvement* Standardized achievement tests of vocabulary* reading 
comprehension* arithmetic computation* and arithmetic reasoning were 
administered in 16 States. Raw scores were converted to grade score 
units and five derived scores were computed* The GATB and nonreading 
tests were also administered* Mean achievement test improvement was 
approximately nine grade scores or* one grade equivalent for a mean 
of 208 hours of training* Initial reading achievement* minority group 
status* GATB aptitudes* and nonreading test performance predicted 
arithmetic achievement improvement . In general* the same variables 
not predict or were not as predictive of reading achievemei 
i mp rove iron t« 

Back ground 

The first phase of this study was reported in USES Test Research Report 
No. 24* "Relationship between Education and Achievement for Disadvantaged 
Individuals in Literacy Training" (U, 5* Department of Labor* December* 

1968), The correlation between total achievement scores and years of 
education for the total sample was ,34. Correlations between total 
achievement score for subsamples defined with reference to demographic 
variables ranged from *08 to *57* Variables that affected the relation- 
ship of education and achievement were age ^ level of education* sex* 
minority group status* and geographical region* 

Purposes 

1* To determine the amount of improvement in tested achievement In basic 
reading and arithmetic skills resulting from literacy training. 

2* To investigate variables related to the magnitude of improvement in 
basic reading and arithmetic skills resulting from literacy training. 

P rocedure 

S amp le . Disadvantaged inaividuals in training projects scheduled to start 
in July and August of 1967 were selected for the study* Four types of 
MDTA projects (Multi-occupational* Regular* Youth* and Youth Multi-occupational) 
plus one 0E0 project and one OJT project were selected to be typical of 
literacy training projects for disadvantaged persons throughout the United 



5 



States at that time. Host of the individuals in the sample meet the 
common criteria; of disadvantaged 6 but they are not necessarily 
representative of all disadvantaged persons* 

The research design is attached as Appendix A* 

Teat Administration * Before training or within the first week of training* 
subjects were tested with Standardised tests of reading and arithmetic 
achievement* The four basic skills of vocabulary * reading comprehension * 
arithmetic computation t and arithmetic reasoning were tested by adm in i $t @ ri n g 
one of the following tests t 

1. Stanford Achievement Test (Primary II * Intermediate II * and 
Advanced levels) 

2 S Metropolitan Achievement Tests (Elementary and Intermediate levels) 

Different levels of achievement tests were used both before and after 
training. In the South most subjects took Stanford Primary II before 
training and Stanford Intermediate II after training* This procedure 
assumes that the grade scores are a common scale for both test levels* 

Raw scores were converted to grade score units using the publishers 3 
conversions o Publishers 3 grade norms permit comparison of a test score 
with scores made by pupils with specific grade status. Ten .grade score 
units equal one grade equivalent. The grade score may be translated 
into a grade equivalent by placing a decimal point before the last digit. 

The grade equivalent indicates the median score made by pupils at a specified 
grade placement. Derived scores included the following: 

d* Reading score - an average of the vocabulary and reading 
comprehension grade scores* 

2* Arithmetic score - an average of arithmetic computation and 
arithmetic reasoning grade scares, 

3. Total achievement score - an average of reading and arithmetic 
s cores « 

Di^e^pancy score - derived by subtracting total achievement 
score from reported years of education and adding a constant 
of 100 to eliminate negative scores* 

b. R g adi n g minus arithmet 1 a s core - computed by subtracting 
arithmetic from reading and adding a constant of 100 to 
eliminate negative scores, 

O 
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Following the administration of achievement tests but not later than 
the first week of training,, ten of the 16 participating States also 
administered the GATE * Form B-1002A* and the nonreading tests. Scores 
on the nonreading tests which were considered invalid were dropped* 

GATE subjects were selected according to passing performance on the 
GATE Screening Exercises which Here administered first* 

At the time of initial testings data for all subjects were collected 
for age e education * sex^ minority group status* and geographical 
region* 

At the conclusion of literacy training* the duration of which varied 
for different projects and different IndividuaJ.3 * subjects who v/ere 
still available were retested with standardized achievement tests 
in 16 States and with the GATB , Form B- 100 fB in ten of these States* 

The following achievement improvement scores were computed; 

1* He a di ng im p r Qve menf score - the retest reading score minus 
the initial reading 'score plus a constant of 100 

2* Arithmetic improvement s core - the retest arithmetic score 
mxnus the initial arithmetic score plus a constant of 100 

3# Total improvement score - the recast total score minus the initial 
total score plus a constant of 100, 

The following additional information was recorded for each individual 
at the time of retesting: 

1* Number of hours of literacy training 

2* Duration of literacy training in weeks 

3 * Intensity of literacy training; average number of hours of 
literacy training per week 

4* Relationship of literacy training to vocational training: 

(1) concurrent with vocational training 

(2) preceding vocational training 

(3) no vocational training 

5* Completion of literacy training: 

' ) completed planned literacy training 

(2) dropped out of literacy training for non-training related 
treasons 

(3) dropped out of literacy training for academic reasons 

It is important to note that retesting was not done in all projects or 
for every subject who entered training. Therefore the number of subjects 
O ^tested is smaller than the nuipber tested initially. However* only one 
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subject: was dropped from training for academic reasons* 




achievement tests were administered to 578 subjects and achievement 
retests were administered to 377 subjects. Fewer than 200 subjects 
were tested with the initial GATE* the retest GATB , and the nonreading 
tests. Approximatley 40 subjects participated in all phases of testing 
However, the majority of subjects participated in one, two, or three 
phases of testing. In order to use all available data, individuals 
who were tested on on# or more tests were retained in the sample. 

Statistical Treatment . Residual gain scores were computed for each 
individual. Residual gain is the difference between retest performance 
predicted from initial test performance (based on a test-retest 
correlation) and the observed or actual retest score. The general 
formula for residual gain is 



Residual gain is a measure of how much each individual differs, in terms 
of the amount of his change score, from the group mean. Residual gain 
was computed for reading, arithmetic, and total achievement scores. 

Statistical computations include inter cor relations , analysis of variance 
means and standard deviations* 

Results and Discussion 

Descriptive data are shown in Tables 1, 2, and 3. Means for age and 
education were 24.2 and 9,6 ye r rs , respectively. These figures are 
very similar to those reported for 578 cases in the first phase of 



RG = G - 'g 



RG = residual gain 
G = actual or observed gain 

G - predicted gain 



The predicted gain was computed from the f ormula : 




t = correlation between initial test and retest 

Si = standard deviation of initial test 

Sr - standard deviation of retest 

Xi s initial test score 

Mi ^ initial test mean 

Mr - retest mean 
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the study on disadvantagsd persona in literacy training 
reeexved an average of 208 hours training in approximately 
The average intensity of training was 20 hours per week. 



Subjects 
11 weeks 



Table 1 



Means and Standard Deviations for Demographic and Literacy Training Variables 

(N- 377 ) 



Data In Table 



Variable 


M 


b I 


Demographic 




■ 


Age (years) 


21+.2 


9.0 


Education (years) 


9.6 


2.0 


Literacy Training 






Number of hours 


208.0 


100 . 6 


Nxtmber of weeks 


10. 9 


2.8 


Number of hours per week 


20.2 


10.7 



9 grade score? 
The Initial 



(about one grade equivalent) above mean initial test scores* 
test mean scores for 377 cases in Table 2 are not significantly different 
from comparable mean scores for 578 cases shown in the USES Test Research 
Report No. 24. 



Table 2 



Means and Standard Deviations for Initial Achievement Test Scores 
and Detest Achievement Scores in Grade Score Units 

(N® 377 ) 



Achievement Score 


Subscores 


Reading 


Arithmetic 


Total 


M 


S.D. 


V 


js.D. 


M 


S.D. 


Initial Test 
Retest 


63.3 

71.3 


23.U 

23.2 


59.5 

68.8 


j— 

19.1 

20.6 


61.5 

70.1 


19.7 
20 J 4 


Difference between 

Initial and Retest Means 


8.0 




9.3 




8,6 





O 
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Means and standard deviations t 

shown in Table 3* The standard de lilt ions ' ~T Residual Gain are 

correlated variables are almost idenSc^l Co tW ° hi ^ 

deviations m Tables 2 and 3 shows Ihll • C ° n,p f rison of standard 
varies most on reading but improvem^n^veS^ P erfo ™»™ 

. ovement vanes most on arithmetic. 

Table 3 

Means and Standard. Deviatiom! f„„ A , , 

Gain Scores Computed fro „ Initial‘ ; md' r S l ^t I ? P r? 1re '' ent Snd «»sldiMl 

Grade Scor, Ur*£ **«ve M nt Scores In 

(H=377) 



Computed Score 



Achievement Improvement 
| Residual Gain 



Subs cores 

Heading j Ari thin© tic 
M 



Total 



S.B, 



(106.0 10.9 109.3 12,1 

*8 j 10,7[ -1,2 J 12.0 




M 



108,8 

- 1.0 




S e D 



, . — I * > “J-e^ —1.0 o ,-j 

Intercorrelations of aubscnr^ ^ ~ J ! —I l-JJZ 

shown in Table 4. Subs cor*#* * +* 0r * eac ^ ae ^ieveiTient score vari^hi 



Table | t 



O 
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Correlations between comparable subs cores are shown in Table 5, Test- 
retest correlations are high, the correlations between Initial Achievement 
Scores and Improvement are low and negative j the correlations between Retest 
Scores and Improvement are low and positive. Initial Scores do not 
predict Residual Gain. Retest Scores have moderate correlations with 
Residual Gain, The highest correlations between Retest Scores and 
Improvement and between Retest Scores and Residual Gain are for 
Arithmetic subscores. The highest correlations shown in Table 5 are 
between Achievement Improvement and Residual Gain Scores indicating 
a very dependable relationship between these two variables. 

Table 5 

Correlations? between Comparable Subscores for Achievement Score ,ir±ables 

(N-376 or 377) 



Ac hievement 
Seor© 


Subscore 


Achievement Score 


... 

Retest 


Improvement 


Rasidual Gain 


a 


1 

! Arithmetic 

1 


Total 


1 Beading 


o 

£ 

5 


— 

Total 


J 


Arithmetic 


Total 


Initial 


Reading 

Arithmetic 

Total 


.89 


.81 


.90 


-.25 


-.18 


-.Hi 


-.03* 


-.03* 


-.02* 


Retest 


Reading 

Arithmetic 

Total 








= 21 


.38 


.29 


9 k3 


• So 


•h2 


Improvement 


Reading 

Arithmetic 

Total 


J 










J 


.9h 


.91 


,9h 



* Correlations axe not significant at the .05 level or above „ AH u nmar ked, 
correlations axe significant at the .01 level. 



All variables were studied in relationship to Improvement and Residual 
Gain, Data in Table 6 shows no significant correlations between v tinuous 
demographic variables or literacy training variables and Improvement; or 
Residual Gain Scores. 
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Table 6 



r f?^ r q lat;LOn c °®f' ric:L e n fcs between Improvement and Residual 
G Scores and Demographic and literacy Training Variables 





(N=„76 or 377. Mono of the r's shown are significant at the .05 level.) 



JESS SSL l Test “2T 1 Gain is ^ 

luetic. ^ 3nd the c ^«P«ted score Heading minus AKLth- 



Table 7 



Correlation Coefficients between Improvement and Residual 
Gam Scores and Initial Achievement Test and Hates t Variables 



(N-376 or 377) 
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no «» 




F— Finger Dexterity 
M — Manual Dexterity 



Table 10 

Correlation Coefficients between Monreading Tests, and Improvement and Residual Gain Scores 
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•Significant at the .05 level 
••Significant at the ,01 level 
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There ners systematic differences in Improvement and Residual G4ln for 
individuals classified according to minority group status, Data ara 
shown in Table 8* Group differences on Arithmetic Improvement Seor^y 
and Arithmetic Residual Gain Scores were most significant* Significant 
differences for Total Scores apparently reflect group differences on 
Arithmetic, Group differences on Reading were not significant * 

Correlations between GATE Aptitudes and Achievement Improvement and 
Residual Gain are shown in Table 9, Correlations range from insignificant 
to moderately high* The GATE Aptitudes hav© the best prediction for 
Arithmetic Improvement and Arithmetic Residual Gain Scores, 

Nonreading test scores shown in Table 10 predict Arithmetic Improvement 
Arithmetic Residual Gain* In general* performance on nonreading 
tests does not predict Reading Improvement or Reading Residual Gain 
Scores * 

Conclusions 



The results of this study should be considered suggestive rather than 
conclusive because of the number of uncontrolled variables which may have 
influenced the data* A total of five different test forms * each with 
different original norm samples * were used to determine before and after 
achievement level* There were differences between geographic regions in 
the test levels used, both before and after testing* which Introduced 
the additional possibility of complex interaction effects* In addition * 
some States reported a preponderance of males or of females because 
of differences in the pregrams for khich trainees were being prepared* 

Wide differences in duration and intensity of training were - sorted and 
differences in the level and content of training undoubted also existed* 

With all the confounded variation known to be present ip. the data* caution 
in the interpretation of the results is particularly important in this study* 
Observed mean differences in initial and retest scores and differences in 
subgroup performance may be due partly or entirely to uncontrolled 
variations in background 5 treatment or measurement conditions. 

However* since such conditions tend to reduce the sis© of correlation 
coefficients* reported relationships expressed as correlations should 
be lower than the true relationships* Thus a repetition of the study 
should produce correlations as high or higher than those reported here* 

Re commend at i ons 



This study should be repeated under more controlled conditions to produce 
data more capable of interpretation* Standard conditions of initial testing, 
training and retesting should be maintained either through experimental 
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or statistical control. If conditions cannot be made standard, large 
enough samples should be collected to make possible separate analyses 
for each combination of initial test, training and retest. Control 
groups would also be desirable to determine whether factors not 
related to basic literacy training contribute to improvement. 



Because reading improvement was not predicted as well as arithmetic 
improvement, it is recommended that additional potential predictors 
of reading improvement be added to the initial. test battery. 



17 



14 



REFERENCES 



fener al Aptitude T^st * Manual for the 
U ' s * fevern rne n t PrTHH ni^O>f j c e"ri3^t ‘o b 0 r 

report no.’l^devllo^nt oTTnlnr^tdin^ldtl^ * g USES t@3t r9search 

Test flattery, U. S. Employment Service, Washi^f ^ 

report nc. ^^r^lftioSship^etwIen e^c£t * '^ ES te3t search 

individuals in literacy training. u S L°? achievement for disadvantaged 
December 1968. g * Ut S ' Employment Service, Washington, D.cf, 



IS 



Introductory 

Note 



Purposes 



Sample 



APPENDIX A 



Experimental Design for Test 
Research on MPT A Trainees in Basic Skills Training 



The basic purposes of this study are shown in staternants 
Cl) and (2) below. However, if sufficient testing time 
can be arranged for. State agencies are also urged to 
undertake the additional work involved in purpose (3), 
Information in the design relative to optional purpose (3) 
is indicated by a double asterisk (**); information so 
Indicated may be disregarded by States carrying out only 
purposes (1) and (2). 

(1) To determine the discrepancy between years of education 
claimed and tested achievement in basic reading and 
arithmetic skills for disadvantaged individuals 
receiving literacy training under the MDT A, and to 
investigate variables related to the magnitude of this 
discrepancy « 

(2) To determine the amount of improvement in tested 
achievement in basic reading and arithmetic skills 
resulting from MDTA literacy training and to investigate 
variables related to the magnitude of the improvement, 

*»(3) To accomplish one or more of the research purposes 
specified in Experimental Design No, 7 (April 1965) 
for USES Test Research on MDTA Trainees, These purposes 
are;^ (a) to develop a Literacy Aptitude Pattern for the 
prediction of improvement in literacy training; (b) to 
determine the relationships between Scores on tests 
administered before and after literacy training, and 
(c) to determine the validity of aptitude measures 
administered before literacy training for predicting 
GATB Aptitude scores after literacy training. Copies 
of Experimental Design No, 7 are available upon request 
fro the national office (attention EMTT), 

The sample is to consist of individuals enrolled in MDTA 
projects and/or project sections in selected States which 
are scheduled to start in July 1967, These projects, providing 
basic education or literacy training to those needing itj 
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Initiation 
Research 



C ? OS ? n the Branch <= f Training Operations 
oro^=L (S “ 1 - Sti " S in A PP«"dlx A)? The 
be tSica? ? ^ OJ0 P rise a national sample which will 
be typical of disadvantaged trainees receiving liter*™ 

States* 1 ^ ?^e e Lt h l MDTA throughout thf Uni^T 

fn 20 Stages jit b@ Gained from projects 

cases Except- ? ?° b ? n ^ al sam P le totals about 870 
specified later In ^“f iv ^ du f ls eliminated for basons 
literacy training in th ^11 individuals receiving 

sections shouid be inclLiMHhe^f ,“p^ PTOjeCt 

jpMV^'proSntJ^tion ^rl^nf^ vTstltT 

time with project personnel and ensuring^that test^ g 

ssssr.liiSd*” 1 ^ 1 - 71,8 =™ s 

Sieve Jnt ?i« ?™ £ V? Mpl ~ ° f th * 

levels *n e*«e. * orm W § Primary II or Intermediate II 
test supplies orTh^d^ d ° n0t haV * SUfficient achievement 

a^on%T?L^ administer 

can provide cnnU, (3} » the nat ional office 

and supplies of !h e SATb'sc*^ 3 ^^ a Ptitude test booklets 
Appendix 5 li«s the fl Sere «*^»g Exercises, as needed, 
their aininistration &£?"'*** ^ ^ ^ 

W±th *«*•<* 

before the * f t testing, and as far as possible 

(attention.* EMTT) «itb a Sv t I the ? atlonal °^ice 
Thi, information is ™edld“r t Je 

of Whether the agency is ^ f 1 offxee regardless 

end <J) or ell t^e^uIposC! °" ly PUrpMe3 <« 

(1) Humber of expected trainees to receive literacy 

iCel S ^Er'* SVera8S educational 



( 2 ) 



( 3 ) 



( 4 > 



place. 0 ” WhlCh initlal testing and retesting will take 

J^UtSSd°? ° f t f sts . that hav « been or will be 
administered for selection or counseling ponpesese 

?^(in1icafe e |r?:ir: d ri lf ? r) ° £ **•*«* Achievemenl 
unaicate Primary II or Intermediate II level). 
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(5) Amount of additional testing time (beyond that 
required for achievement testing, and exclusive 
of time required to administer tests listed 
in (3) above) available at the beginning and at the 
end of training to accomplish the purposes 
of Experimental Design No* 7 (purpose (3) of 
this design* ) 

** (6) Number of copies on hand of e ach the 10 non- 

reading aptitude test booklet TNCS edition) 
and GATE Screening Exercises* 

(7) Approximate duration of literacy training to be 
provided (weeks) and amount (number of hours). 



(8) Any anticipated problems. 



"" On the basis of this information* the national office ill 
recommend aptitude test batteries to be administered and 
will provide any additional conies of the non-reading 
aptitude teat booklets or GATE Screening Exercises needed 
by States* 



Data Collection: 

Initial 

Testing Prior to the start* or within the ^irst week of literacy 

training* the tests listed below are to be administered to 
only those individuals in the prelect section who are 
expected to receive literacy training* Any individuals 
who are tested but are later found not to be receiving 
literacy training should be dropped from the sample* 

(1) Four subtests of the Primary II level of the Stanford 
Achievement Test; Word Meaning* Paragraph Meaning* 

Arithmetic Computation* and Arithmetic Concepts, 1 
Administration time will be approximately 2 hours- if 
feasible the tests should be administered in two sessions, 
individuals whose scores fall outside the ranges shown 
in Appendix B should be retested with a more appropriate 
level if possible* or dropped from the sample. Raw scores 
should be converted to grade scores, (If an individual 
must be retested with different levels of one or two sub- 
tests for this reason* his retest scores may be substituted 
for the first scores and treated as though they were his 
first scores,) Grade scores on the Word Meaning and 
Paragraph Meaning subtests should be averaged to derive an 
Initial Reading score * grade scores on the Arithmetic Computation 



rA different level of the StarTford may be used if indicated by the educational level 
of the examinees. Comparable sub tests of the Metropolitan * California or other 
standardized achievement test series may be substituted. It may be possible to 
obtain achievement test scores from E3 records rather than administer the tests 
specifically for this study. 




gi 



18 



Siid Arithmetic Concepts subtests should be averaged 
to derive an Initial Arithmetic score t and the Initial 
Reading at ! Initial Arithmetic scores should then be 
averaged to obtain an initial Total Achievement score, A 
’’discrepancy score” should also be derived by subtracting 
Initial Total Achievement score from years of education 
(plus constant of 100). 

(2) The aptitude test battery recommended by the national 

office should be administered on another day(s) following 
the administration of the achievement tests but not 
later than the first week of training. Depending upon 
the testing time available and the trainees' level 
of education, the recommended battery may be either/or both 
of (a) and (b) below, 

(a) Some or all of the non-reading aptitude tests. Total 
administration time for all 14 tests is about 4 hours. 
Individuals whose scores on one or more of the non- 
reading aptitude tests are judged invalid by the test 
administrator should be dropped from the sample for 
purpose (3), although they should remain in the sample 
for purposes (1) and (2), 

(b) GATB, B-1002A, preceded by GATB Screening Exercises. 
Individuals who fail either part of the Screening 
Exercises should be dropped from the sample for 
purpose (3) although they should remain in the sample 
for purposes (1) and (2). 

The following additional information for each individual should 

be obtained from ES records or from the individual prior to the 

start of the literacy training. 

(1) age (years) 

(2) education (years) 

(3) sex 

(4) minority group status (to be determined by observation or 
provided by individuals) 

(5) had any other formal education since leaving regular school? 

(6) length of time since most recent formal education, regular 
school or other (years) 

(7) geographical region in which majority of education obtained 
up to age IB (see Appendix C for U. S, Census classification 

22 
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to code States into geographical regions) 

Dat a 

Colle Qtion ; 

Retesting At the conclusion of each Individual's literacy training * 
the tests listed below are to be administered* The 
duration of training need not be the same for all 
individuals* If possible * individuals who drop out of 
training should be retested before they leave* Regardless 
of whether retesting can be done, for each individual who 
drops out of literacy training planned for him* an 
evaluation should be obtained from the Instructor as to 
whether or not the dropout can be attributed to academic 
difficulties. 

(1) Four subtests of the Intermediate II level of the 

Stanford Achievement Test: Word Meaning* Paragraph 

Meaning* Arithmetic Computation * and Arithmetic 
Applications. 1 If feasible* the tests should be 
administered in two sessions. Individuals whose scores 
fall outside the ranges shown in Appendix D should 

be retested with a more appropriate level if possible* 
or dropped from the sample. Retest Readings ketest 
Arithmetic* and Retest Total Achievement scores should 
be derived. 

Reading* Arithmetic* and Total Achievement Improvement 
scores should be derived for each individual by sub- 
tracting initial from retest grade scores (plus a 
constant of 100 ) # 

(2) GATB * B-1002B* administered on another day following 
administration of the achievement tests. 

The following additional information should be recorded for each 
individual at the time of retesting 

(1) Total number of hours of literacy training provided. 

(2) Duration of literacy training (weeks). 

^Comparable subtests of the Metropolitan, daii^omia, or othe "standardized 

achievement test series may be substituted, provided that the same series is 
used for^ retesting that was used for initial testing. A level other than 
Intermediate II may be used If training has been cf short duration; an alternate 
form ^ should be used for retesting if the same leval of testa is used for both 
initial testing and retesting* 
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Report and 
Submie-slon 
Data 



Data 

Analysis 



s 3 } Intensity of t. dning: average number’ of hours of 

literacy training per week* 

(4) Whether literacy training was concurrent with* or preceded, 
vocational training, 

(5) Whether trainee completed scheduled literacy training * 
dropped out for reasons not related to the literacy 
training* or dropped out because of academic difficulties. 



Data for each individual to be included in the analysis 
for purpose <1) are to be submitted in the form of a 
punched card (Card 1) prepared according to the instructions 
in Appendix E„ Card 1 should be punched only for individuals 
for whom complete test score data are available. 

Data for each individual to be included in the analysis for 
purpose (2) are to be submittc in the form af a punched 
card (Card 2) prepared according to the instructions in 
Appendix F, Cards 1 and 2 should be provided for the 
same individuals. 

Additional data for each individual to be included in the 
analysis for purpose (3) are to be submitted in the form 
of two additional punched cards (Cards 3 and 4) prepared 
according to the instructions in Appendix G. 



Decks of Cards 1 and 2 should be submitted within 6 weeks 
after the completion of initial testing* and decks of 
Cards 3 and 4 should be submitted within 6 weeks after the 
completion of all retesting. 

All card punching should be verified. 

Each deck should be accompanied by a machine listing or 
Work Table No. 1 showing all data contained on the cards. 
Each submittal should be accompanied by a brief report 
describing the project and sample characteristics and 
any limitations of the data. 



All data analysis will be carried out by the national office. 



21 - 



In connection with pus-pose (1)* the correlations 
between years of education and the various measures 
of initial tested achievement will be obtained, and the 
mean discrepancy between years of education and tested 
achievement will be found for individuals at various levels 
of education. A number of biographical variables will be 
investigated as moderators of the relationship between 
years of education and tested achievement* 

In connection with purpose (2), the average improvement 
in tested achievement will be determined for individuals 
at various levels of initial tested achievement. Correlations 
between initial and final achievement will be computed* The 
relationships between a number of biographical variables 
and amount of improvement will be investigated. 

In connection with purpose (3) f correlations between 
aptitude scores before and after training will be computed. 

The predictive validity of aptitude measures before 
training against improvement in achievement will be 
determined, and a number of biographical variables will 
be investigated as moderators of these relationships. 

Analysis will be done to determine the combination of aptitude 
measures (to be called Literacy Aptitude Pattern), which 
best predicts performance in literacy training. 
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APPENDIX B 



Statistical Data 





Intercorrelations between Improvement and Residual Gain Variables and the Following Variables: 
Demographic, Initial Achievement Test, literacy Training;, and Retest Achievement 

(M's ■ 376 or 377} 





j Residual Reading 

I Gain Arithmetic 



lots rcorrelationa between Lmprcveroent and Residual Gain Variable a; and Initial GATE Test Aptitudes .and GATE .Retest Aptitudes 

(M’s are shown in the lower left portion of the matrix) 
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OATH Eatest Aptitudes and Nonreadiag Test Scores 
lti the lower left portior. of the matrix:) 
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Table 7 



n .'- .".ne 



‘ 7 d E^-Q 1)9 'v I Q-bi 9 .ns 






;-V.L vi u v :1V ' ' 1 a b lie £ 



^ ! ‘ L"v -* 4 - %d 

.training Variables and Achievement Test Score,? 
in Grade Score Units 



O 

ERIC 



variable 


T~ n j n 


j S.D. ! 


' Pornographic Variables 


j j 


“ ‘ * 1 


Age (years) 


! 377 i 24.2 


9*0 ] 


Education (years) 


j 377 ; 9.6 


2.0 i 


Sex (maXe-lj female -2) 


j 377 J 1.6 

! : 


.5 


■ literacy Training variables 


i ! 




Number of hours 


! 377 :?08 a 0 il00.6 


Number of weeks 


377 i 10.9 


2 e 8 


Number of hours per week 


I 377 ; 20 » 2 


10,7 ; 


f -p. 

•; Initial Achievement Test Scc.ves 


j ‘ 


* 


j Achievement Test Sample 


j ! j 




i Re ading 


I 377 ; 63,3! 


23 »k 


■ Arithmetic 


[ 377 i 59.51 


19,1 


| Total 


! 377 : 61.5 ! 


19® 7 


j Discrepancy 


1 377 jl3U.5 ! 


24.0 i 


: Heading minus Arithmetic 

j 


i 377 1103,8 j 

j • | 


16.8 


j Initial GATE Sample 






« Heading 


liil j 55.1 ! 


21 s 8 


! Arithmetic 


no. : 52 , 2 ! 


15 1 6 ! 


j Total 


Hii 53 . 6i 

l ’ 


17,8 i 


| Retest GATE Sample 


j 

1 1 


i 

| 


j Ha ading 


131 ' $$»k\ 


21. k i 


i Arithmetic 


131 < 52.9 | 


15.0 ! 


j Total 


131 : 54.1 


17 , a 



^*i 

*:» 



Nonreading Test Sample 



Arithmetic 

Total 

Retest Achievement Scores 
Reading 
Arithmetic 
Total 

Achievement Improvement 



173 ; 

173 j 52.9 
173 j 54.7 



21,9 
15,2 
17,8 



Arithmetic 

Total 

Residual Gain 
Seadins 
Arithmetic 
Total 



377 

377 

377 



377 

377 

377 



377 

376 

377 



71,3 

68.8 

70.1 



108.0 

109.3 

108.8 



- .8 

- 1.2 

- 1 . 0 ' 



23.2 
20,6 
20. U 



10.9 

12.1 

9.0 



10.7 

12.0 

9.0 



Table VI 



Means and Standard Deviations for GATts Aptitude Scores 

and Nonreading Test Scores 



Variable 


N 


M 


ScBo 


GATB-BI002A-Initial Test Aptitudes 
G-Intelligence 


141 


77.1; 


1 

\ 

13.6 1 


V-Verbal 


lla 


80.2 


11.6 i 


N-Numerical 


141 


76.1 


18.3 1 


S-Spatial 


1U1 


85-0 


16.9 ! 


P-Form Perception 


m 


83.8 


21.6 ! 


Q-Clerical Perception 


141 


91.2 


15.1 1 


K-Motor Coordination 


mi 


86.3 


22.2 | 


P-Finger Dexterity 


141 


82.0 


25® 6 ! 


M-Manual Dexterity 


lUi 


86.1 


26.0 i 

i 


QATB~B1002B-Retest Aptitudes 
G-Inte lligenee 


131 


78.9 


13.8 | 


V- Verbal 


131 


81.5 


9.7 i 


N-Numerical 


131 


78.4 


18.6 i 


S-Spatial 


131 


91.0 


18.6 j 


P-Form Perception 


131 


92.0 


22.2 j 


Q-Glerical Perception 


131 


95.0 


15.4 : 


K-Motor Coordination 


131 


94. 6 1 


j 20 ^ I 


F-Finger Dexterity 


131 


92,8 




M-Manual Dexterity 


131 


98.0 j 


| 24.2 j 


Nonreading Tests 




30.5 


\ \ 

i | 

! 8.4 


X-0 Matching 


173 


Picture Memory (Part 2) j 


162 


20.5 


j 5.3 


Form Matching 


172 


23.0 


; 8.6 


JLetter Cancellation 


173 


54.3 


18,5 


Substitution (Fart 1) 


173 


28.4 


9.4 


Substitution (Part 2) 


173 


56.1 


17.7 


Substitution (Part 3) 


172 


27.8 


21.5 


Coin Matching 


173 


18.8 


s 6.4 


Matrices 


172 


14.0 


; 7.2 


Symbol Series 


1 64 


6.6 


! 4.0 


Tool Matching 


173 


28.3 


| 8.8 


Picture Word Matching 


173 


26.6 


j 5.8 


Oral Vocabulary 


173 


23.2 


6.4 


Three Dimensional Space 


173 


13.7 


5*9 


Coin Series (Part 1) 


172 


23.9 


20.8 


Coin Series (Part 2) 


173 


16.2 


13.5 


Coin Series (Part 3) 


171 


13.6 


12.2 


Patterns (Part 1) 


172 


Hi. 9 


8.8 


Patterns (Part 2) 


172 


13.2 


8.3 



O 

ERIC 
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